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flj , We propose two efficient algorithms for configurational sampling of systems with rough energy 

e landscape. The first one is a new method for the determination of the multicanonical weight factor. 

In this method a short replica-exchange simulation is performed and the multicanonical weight factor 
is obtained by the multiple-histogram reweighting techniques. The second one is a further extension 
of the first in which a replica-exchange multicanonical simulation is performed with a small number 
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^ , of replicas. These new algorithms are particularly useful for studying the protein folding problem. 

I. 

I. INTRODUCTION 

^ ' With the great advancement of computational science over the past decades, partly due to the rapid growth of 

O I computer technologies, scientists in many research fields are now attacking realistic problems with large degrees 
of freedom and complexity. When dealing with systems with rough energy landscape, simulations by conventional 
molecular dynamics (MD) or Monte Carlo (MC) methods are of little use, because at low temperatures they tend to 
get trapped in local-minimum energy states and sample only a very limited region of the configurational space. The 
^ ' development of new powerful simulation algorithms that can alleviate this difficulty is thus particularly important. 
O^ , Multicanonical algorithm (MUCA) fn| may be one of the most popular methods that can sample a wide phase 

space (for a review, see, e.g., Ref. [^[). A simulation in multicanonical ensemble is based on a non-Boltzmann 
weight factor, which we refer to as the multicanonical weight factor, and a free random walk in potential energy 
^S ' space is realized. The random walk can overcome any energy barrier and allows the simulation to escape from 
f^ local-minimum states. Monitoring the potential energy throughout a MUCA simulation, one can obtain not only 
^^ , the global-minimum energy state but also canonical-ensemble averages of any physical quantity as a function of 
.4.^ ■ temperature. The latter is accomplished by the single-histogram reweighting techniques ^J. The multicanonical 
3 . weight factor is usually determined by iterations of short trial simulations (the details of this process are described, 
^ ' for instance, in Refs. ^,3). This iterative process can be very difficult and tedious for complex systems, and there have 
i^ I been attempts to accelerate the convergence of the iterative process ^- [Q. Despite these efforts, the determination 

of the multicanonical weight factor still remains to be non-trivial ||] . 

Q ' Another powerful algorithm is the replica-exchange method (REM) jllUl2]. (A similar method was independently 

^ developed earlier in Ref. [ |l3| . REM is also referred to as multiple Markov chain method |lj] and parallel tempering 

sj p5[.) In this method, a number of non-interacting copies of the original system (or replicas) at different temperatures 

.,— I ^ are simulated independently and simultaneously by the conventional MD or MC methods. Every few steps, pairs 

p\. • of replicas are exchanged with a specified transition probability. This exchange process realizes a random walk in 

JH [ temperature space, which in turn induces a random walk in the energy space so that a wide configurational space can 

■ - - ' be sampled during the simulation. The multiple-histogram reweighting techniques ||l^,0 (an extension of which is 

also referred to as WHAM [O) are used to calculate various canonical-ensemble averages as a function of temperature. 

In the replica-exchange method the weight factor is just the product of Boltzmann factors, and so it is essentially 
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known. However, REM also has a weak point: It is difficult to study the first-order phase transitions, because the 
replica-exchange rates passing the first-order transition temperatures are greatly reduced. 

In a previous work we have developed a molecular dynamics algorithm for REM ||l8[ (see, also, Refs. |19 2^). We 



then developed a multidimensional REM |£1| (see, also, Refs. P^ , p3| ). In this Letter we try to combine the merits 
of multicanonical algorithm and replica-exchange method. In the first method, which we refer to as replica- exchange 
multicanonical algorithm (REMUCA), a short replica-exchange simulation is performed and the multicanonical weight 
factor is determined by the multiple-histogram reweighting techniques p6| , [L7[ . (We remark that the multiple- histogram 
reweighting techniques are also used during the regular iterations of multicanonical weight factor determination in 
Refs. p,Qffl). We then present a further extension of the new method, which we refer to as multicanonical replica- 
exchange method (MUCAREM), where a replica-exchange multicanonical simulation is performed with a small number 
of replicas. The effectiveness of these methods is tested with a short peptide, Met-enkcphalin, in gas phase. 

II. METHODS 

A. Replica-exchange multicanonical algorithm 

In the multicanonical ensemble |ffl,p[ each state is weighted by the multicanonical weight factor, Wmu{E), so that a 
flat potential energy distribution, Pmu{E), is obtained: Pmu{E) oc n{E)Wmu{E) = const , where E is the potential 
energy and n{E) is the density of states. We can then write 

where we have chosen an arbitrary reference temperature, Tq = l/ksfio {ks is Boltzmann's constant), and the 
^^multicanonical potential energy" is defined by 

Ernu{E;To) = kBTolnniE) . (2) 

Since the density of states of the system is usually unknown, the multicanonical weight factor has to be numerically 
determined by iterations of short preliminary runs [y^] . 

Once the weight factor is given, multicanonical Monte Carlo simulation is performed, for instance, with the Metropo- 
lis criterion. The molecular dynamics algorithm in multicanonical ensemble also naturally follows from Eq. (|l|), in 
which the regular constant temperature molecular dynamics (with T = Tq) is performed by solving the following 
modified Newton equation: p4| , p5|JlC| | 

dE,nu{E;To) dEmu{E;To) 
P'^ = d^, = dE ^' ' (') 

where q^ and p^ are the coordinate vector and momentum vector of the i-th atom, and f^ is the regular force acting 
on the z-th atom. In this Letter the formulations of the new methods in terms of molecular dynanfics algorithm are 
presented. The details of the Monte Carlo versions of the new algorithms have also been worked out and will be given 
elsewhere P^ . 

We now briefiy review the original replica-exchange method (REM) ||ll|- [|l5| (see Ref. |l8| for details). The system 
for REM consists of M non-interacting copies (or, replicas) of the original system in the canonical ensemble at M 

different temperatures T„j {m — 1, • • • , M). Let X — \- ■ ■ , Xm, ■ ■ ■> stand for a state in this generalized ensemble. 

Here, the superscript i and the subscript m in xhl label the replica and the temperature, respectively. The state X 
is specified by the M sets of coordinates ql'l (and momenta p'*'). 

A simulation of the replica- exchange method (REM) is then realized by alternately performing the following two 
steps [|l]- |l5|. Step 1: Each replica in canonical ensemble of the fixed temperature is simulated simultaneously 
and independently for a certain MC or MD steps. Step 2: A pair of replicas, say i and j, which are at neighboring 

temperatures T^ and T„ , respectively, are exchanged: X = <■ ■ ■ , x„i , • • ■ , xH ,■■ ■> — > X' ^ <■ ■ ■ , xln , • ■ ■ , Xn i ' ■ ■ f ■ 
The transition probability of this replica exchange is given by the Metropolis criterion: 

«'<-^--^')-"'(-ak!;')Mexp(-A)j:;A;2: w 

where 
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Here, E (g'*') and E (gf-'l) are the potential energy of the i-th rephca and the j-th rephca, respectively. In the present 
work we employ molecular dynamics algorithm for Step 1. We remark that in molecular dynamics simulations we 
also have to deal with the momenta. It was shown that by rescaling the momenta uniformly by the square root of the 
ratio of T,„ and T„, the kinetic energy terms in the Boltzmann factors are cancelled out and that the same criterion, 
Eqs. (Q) and (||), which was originally derived for Monte Carlo algorithm |11|- [|5| is recovered [ [l8[ . 

The major advantage of REM over other generalized-ensemble methods such as multicanonical algorithm pi lies 
in the fact that the weight factor is essentially a priori known, while in the latter algorithm the determination of 
the weight factor can be very tedious and time-consuming. A random walk in "temperature space" is realized for 
each replica, which in turn induces a random walk in potential energy space. This alleviates the problem of getting 
trapped in states of energy local minima. 

In the replica- exchange multicanonical algorithm (REMUCA) we first perform a short REM simulation (with M 
replicas) to determine the multicanonical weight factor and then perform with this weight factor a regular multicanon- 
ical simulation with high statistics. The first step is accomplished by the multiple-histogram reweighting techniques 
|jl6| , [l7| . Let Nra (E) and n^ be respectively the potential-energy histogram and the total number of samples obtained 
at temperature Tm = l/kslim of the REM run. The density of states, n[E), is then given by [ p^ , p7| 
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Here, gm = 1 + 2t,„, and t„i is the integrated autocorrelation time at temperature T„i. Note that the density of states 
n{E) a nd the "dimensionless" Helmholtz free energy fm in Eqs. (^) and (0) are solved self-consistently by iteration 

Once the estimate of the density of states is obtained, the multicanonical weight factor can be directly determined 
by using Eq. (ol) (see also Eq. (0)). Actually, the multicanonical potential energy, EmuiE]To), thus determined is 
only reliable in the following range: 



Ei<E<Em , 
where Ti and Tm are respectively the lowest and the highest temperatures used in the REM run and 



(8) 



El = <E >Ti 

Em = < E >Tm 



(9) 



Here, < E >x stands for the canonical expectation value of E at temperature T. Outside this range we extrapolate 
the multicanonical potential energy linearly as follows: 
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In the present work the multicanonical potential energy function, EmuyE^To), and its derivative, — '"^^ ' ° 



obtained by fitting the logarithm of the density of states, \Tin{E)^ (which was determined by the multiple-histogram 
reweighting techniques) by the cubic spline functions in the energy range of Eq. (^) . A long multicanonical MD run 

is then performed by solving the Newton equations in Eq. (g) into which we substitute £mu{E) of Eq. (|lO|). 

Let Nmu{E) be the histogram of the potential energy distribution, PmuiE), that is obtained from this multicanonical 
production run. The expectation value of a physical quantity A at any temperature T is then calculated from 



Y,A{E) n{E) e-l^^ 
<A>T = ^^== , (11) 

E 

where the (unnormahzed) density of states is obtained by the single-histogram reweighting techniques [p| : 

We remark that our muhicanonical MD simulation here actually results in a canonical simulation at T — Ti for 
E < El, a, multicanonical simulation for Ei < E < Em, and a canonical simulation at T = Tm for E > Em (a 
detailed discussion on this point will be given elsewhere |M). Note also that the above arguments are independent 
of the value of Tq, and we will get the same results, regardless of its value. 

Finally, although we did not find any difficulty in the case of protein systems, a single REM run in general may 
not be able to give an accurate estimate of the density of states (like in the case of a first-order phase transition). In 
such a case we can still greatly simplify the process of the multicanonical weight factor determination by combining 
the present method with the previous iterative methods Q- [ |l(| . 

B. Multicanonical replica-exchange method 

In the previous subsection we presented a new generalized-ensemble algorithm, REMUCA, that uses the replica- 
exchange method for the determination of the multicanonical weight factor. Here, we present a further modification 
of REMUCA and refer the new method as multicanonical replica-exchange method (MUCAREM). In MUCAREM the 
final production run is not a regular multicanonical simulation (as in REMUCA) but a replica-exchange simulation 
with a few replicas, say A4 replicas, in the multicanonical ensemble. We expect that this enhances the sampling 
further because a replica-exchange process can be considered to be a global update, while multicanonical simulations 
are usually based on local updates. We remark that replica-exchange simulations based on another generalized 
ensemble are introduced in Ref. p9| |. 

We now give the details of MUCAREM. As in REMUCA, we first perform a short REM simulation with M replicas 
with M different temperatures (we order them as Ti < r2 < • • • < Tm) and obtain the best estimate of the density 
of states n{E) in the whole energy range of interest (see Eq. (0)). We then choose a number Ai {A4 <C M) and 
assign Ai pairs of temperatures (T^;'" , T^" ) (m = 1, • ■ • , Al). Here, we assume that T^;" < T^™ and arrange the 
temperatures so that the neighboring regions covered by the pairs have sufficient overlaps. We also set T^ = Ti and 
TJj = Tm- We choose ^A (arbitrary) temperatures Tm (m = 1, ■ • ■ ,M.). We then define the following quantities: 



^1;"^ = <S>J™} , (m = l,---,A^) 

^ H 

and assign the following multicanonical potential energies (see Eq. (foh): 
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where Emu{E;T) is the multicanonical potential energy that was determined for the whole energy range of Eq. (|^). 
The Newton equation in Eq. (|3|) again implies that our choice of £mu (E) in Eq. (^_4|) results in a canonical simulation 
at T = T2™ for E < E}™ , a multicanonical simulation for EJ™ < E < EJ^ , and a canonical simulation at 

T = TJf'UoT E > EJ^''^ 13. 

The production run of MUCAREM is a replica-exchange simulation with A4 replicas with A4 different temperatures 
Tm and multicanonical potential energies Smi (E). By following the same derivation that led to the original REM, 



one can show that the transition probabihty of rephca exchange, w [xhl xfi ), is given by Eq. (^, where we now 



have 



A = 



^™ (4"> {e (g[^l)) - S^rJ {e (,W))) - Pn (ej {e (,[^1)) - £j^ (e (,H))) . (15) 



Note that we need to newly evaluate the multicanonical potential energy, £mu iE{q^^^)) and £mu {E{q^^^)), because 
Smu, (E) and £mu{E) are, in general, different functions for m ^ n. We remark that the same additional evaluation 
of the potential energy is necessary for the multidimensional replica-exchange method [pi| . 

Let Nm{E) and rim be respectively the potential-energy histogram and the total number of samples obtained at 
Tm {m = 1, • • • , A4). The expectation value of a physical quantity A at any temperature T — l/ks/S, < A >t, is 
then given by Eq. (O) , where the density of states is now obtained from the multiple-histogram reweighting formulae 

@0 of Eqs. (|) and (0) with the replacements: M -> M and (i^E -^ /3™£:i™^(^). 

III. RESULTS AND DISCUSSION 

We tested the effectiveness of the new algorithms for the system of a penta-peptide, Met-enkephalin, in gas phase. 
This peptide has the amino-acid sequence, Tyr-Gly-Gly-Phe-Met. The N and C termini of the peptide were blocked 
with acetyl and N-methyl groups, res£ectively. The force-field parameters were taken from the all-atom version of 
AMBER developed by Cornell et al. |2^, and the dielectric constant was set equal to 1.0. 

We have performed MD simulations in the Cartesian coordinates based on the replica-exchange multicanonical 
algorithm (REMUCA) and multicanonical replica-exchange method (MUCAREM). As a thermostat for both MD 
simulations in the replica-exchange method (REM) and multicanonical algorithm (MUCA), we have adopted the 
constraint method |£^,^ in which the total kinetic energy is constant, following Rcf. |25[ where the constraint 
method is recommended for MUCA simulations. The computer code developed in Refs. |3l[,33], which is based on 
PRESTO [^, was used. The unit time step was set to 0.5 fs. The simulations (of all replicas) were started from an 
extended conformation. 

In Table I we summarize the parameters of the simulations that were performed in the present work. As discussed 
in the previous section, REMUCA consists of two simulations: a short REM simulation (from which the density of 
states of the system, or the multicanonical weight factor, is determined) and a subsequent production run of MUCA 
simulation. The former simulation is referred to as REMl and the latter as MUCAl in Table I. A production run 
of MUCAREM simulation is referred to as MUCAREMl in Table I, and it uses the same density of states that was 
obtained from REMl. Finally, a production run of the original REM simulation was also performed for comparison 
and it is referred to as REM2 in Table I. The total simulation time for the three production runs (REM2, MUCAl, 
and MUCAREMl) was all set equal (i.e., 5 ns). Before taking the data, we made regular canonical MD simulations 
of 100 ps (for each replica) for thermalization. For replica-exchange simulations an additional REM simulation of 100 
ps was made for further thermalization. In REMl and REM2 there exist 10 replicas with 10 different temperatures, 
ranging from 200 K to 1000 K as listed in Table I (i.e., Ti = 200 K and Tm = T^ = 1000 K). For the present 
purpose of the work, we believe that this range of temperature is sufficiently wide. The temperatures are distributed 
exponentially between Ti and Tm, following the optimal distribution found in Ref [Q. In REMl and REM2 a replica 
exchange was tried every 20 time steps (or 10 fs) as in our previous work |18[ . 

In REMl each replica was simulated by a constant temperature MD of 2 x 10^ steps (or 100 ps). We first check 
whether the replica-exchange simulation of REMl indeed performed properly. For an optimal performance of REM 
the acceptance ratios of replica exchange should be sufficiently uniform and large (say, > 10 %). In Table II we list 
these quantities. It is clear that both points are met (the values vary only between 13 % and 16 %). Moreover, in 
Fig. 1 the canonical probability distributions obtained at the chosen 10 temperatures from REMl are shown. We see 
that there are enough overlaps between all pairs of neighboring distributions, indicating that there will be sufficient 
numbers of replica exchanges between pairs of replicas (see Table II) . We did observe random walks in potential energy 
space between low energies and high energies. 

After REMl, we obtained the density of states, n{E), by the multiple-histogram method [|l^,0 (namely, by 
solving Eqs. (pi) and (R) self-consistently). For biomolecular systems the integrated autocorrelation times, Tm, in the 
reweighting formulae can safely be set to be a constant [|7|, and we do so throughout the analyses in this section. 
The density of states will give the average values of the potential energy from Eq. (lO), and we found 



El = < £; >Ti= -30 kcal/mol , , . 

Em ^ < E >T^,^ 195 kca\/iRo\ . ^ ' 



Then our estimate of the density of states is rehable in the range Ei < E < Em ■ The multicanonical potential energy 
SLuiE) was thus determined for the three energy regions {E < Ei, Ei < E < Em, and E > Em) from Eq. (|ic|). 
Namely, the multicanonical potential energy, Emu{E;TQ), in Eq. (0) and its derivative, — ^qe ' ° ' were determined 
by fitting lnn{E) by cubic spline functions in the energy region of (—30 < E < 195 kcal/mol). Here, we have set the 
arbitrary reference temperature to be Tq — 1000 K. Outside this energy region, Ejnu{E;TQ) was linearly extrapolated 
as in Eq. @. 

After determining the multicanonical weight factor, we carried out a multicanonical MD simulation of 1 x lO"^ steps 
(or 5 ns) for data collection (MUCAl in Table I). In Fig. 2 the probability distribution obtained by MUCAl is plotted. 
It can be seen that a good flat distribution is obtained in the energy region Ei < E < Em- In Fig. 2 the canonical 
probability distributions that were obtained by the reweighting techniques at T = Ti = 200 K and T = Tm = 1000 
K are also shown (these results are essentially identical to one another among MUCAl, MUCAREMl, and REM2, as 
discussed below). Comparing these curves with those of MUCAl in the energy regions E < Ei and E > E]\f in Fig. 
2, we confirm our claim in the previous section that MUCAl gives canonical distributions at T = Ti for E < Ei and 
at T = Tm for E > Em, whereas it gives a multicanonical distribution for Ei < E < Em. 

In the previous works of multicanonical simulations of Met-enkephalin in gas phase (see, for instance, 
Refs. [MESpS] ) , at least several iterations of trial simulations were required for the multicanonical weight deter- 
mination. We emphasize that in the present case of REMUCA (REMl), only one simulation was necessary to 
determine the optimal multicanonical weight factor that can cover the energy region corresponding to temperatures 
between 200 K and 1000 K. 

From the density of states obtained by REMUCA (i.e., REMl), we prepared the multicanonical weight factors (or 
the multicanonical potential energies) for the MUCAREM simulation (see Eq. (p^)). The parameters of MUCAREMl, 
such as energy bounds Ei^' and ijj^"^ (m = 1, • • ■ ,M) are hsted in Table III. The choices of Ti'' and T^^' are, 
in general, arbitrary, but significant overlaps between the probability distributions of adjacent replicas are necessary. 
The replica-exchange process in MUCAREMl was tried every 200 time steps (or 100 fs). It is less frequent than in 
REMl (or REM2). This is because we wanted to ensure a sufficient time for system relaxation. 

In Fig. 3 the probability distributions of potential energy obtained by MUCAREMl are shown. As expected, we 
observe that the probability distributions corresponding to the temperature Tm are essentially fiat for the energy 
region El'' < E < E)P, are of the canonical simulation at T = y^™^ for E < E]™', and are of the canonical 

simulation at T = T^"'^ for E > E)^^' (m = 1, ■ • • , M). As a result, each distribution in MUCAREM is much broader 
than those in the conventional REM (see Fig. 1) and a much smaller number of replicas are required in MUCAREM 
than in REM (A^ = 4 in MUCAREM versus M = 10 in REM). 

The acceptance probabilities of replica exchange in MUCAREMl are listed in Table IV. Relatively high probabilities 
of replica exchange in MUCAREMl should be noted. In MUCAREMl, the exchange probability is given by Eqs. (0) 
and ([l5|). Suppose that a pair of replicas i (at temperature T^,) and j (at temperature T„) are respectively in the 
energy ranges between E^"^' < E < EJ^' and between e\^^ < E < -Ejif . Then Eq. (|5|) together with Eqs. (§) and 
(0) gives 

A = /3™ (^Ernu [e (q[^l) ; Trn) ~ E,^^ (e (ql'l) ; r„.) ) - /3„ (e„,^ (e (gl-'l) ; T„) - E^^ (e (gl'l) ; r„ 
= \^n{E{q}^\\ -\^n{E{q''^\\ -\^n{E{q}^\\ +lnn('^('gW' 
= . (17) 

Thus, in this case the replica exchange is always accepted. This is the main reason for the high acceptance ratio in 
MUCAREM simulations. 

In Fig. 4 the time series of potential energy for the first 500 ps of REM2 (a), MUCAl (b), and MUCAREMl (c) 
are plotted. Note that in MUCAl (Fig. 4(b)) some extra MD steps are required to escape from the lowest-energy 
region (from about 300 ps to 450 ps) and the transition from the highest to the lowest energy occurs only once during 
the first 500 ps in MUCAl. This is presumably due to the nature of local updates. In REM2 and MUCAREMl, 
such transitions occur twice or three times. This is because global updates by the replica-exchange process make the 
random walk more efficient (more quantitative comparisons of REM, MUCA, and MUCAREM will be given elsewhere 

&■ . . . 

To check the validity of the canonical-ensemble expectation values calculated by the new algorithms, we compare the 

average potential energy as a function of temperature in Fig. 5. In REM2 and MUCAREMl we used the multiple- 
histogram techniques | p^ , p7t (see Eqs. (^ and (|^) for REM2 and the corresponding variants for MUCAREMl), 
whereas the single-histogram method ^ (see Eq. (|2|)) was used in MUCAl. We can see a perfect coincidence of 
these quantities among REM2, MUCAl, and MUCAREMl in Fig. 5. 



IV. CONCLUSIONS 

In this Letter we have proposed two new algorithms for configurational sampHng of systems with rough energy 
landscape. In the first method, which we refer to as replica-exchange multicanonical algorithm (REMUCA), the 
multicanonical weight factor is determined from the results of a short replica-exchange simulation, and then a regular 
multicanonical production run is made with this weight. In the second method, which we refer to as multicanonical 
replica-exchange method (MUCAREM), the multicanonical weight factor is determined as in REMUCA, and then 
a replica-exchange multicanonical production run is made. The number of required replicas in MUCAREM is much 
smaller than in the original replica-exchange method. The new methods were tested with the system of a small 
peptide in gas phase. This is one of the smallest models of protein systems. The multicanonical weight factor was 
indeed obtained by a single, short replica-exchange simulation. It may occur, however, that this first step may not 
be as easy in more complicated systems such as a protein with explicit solvent molecules. In such a case one can still 
simplify the multicanonical weight factor determination by iteratively combining the present algorithms (and also the 
previous methods). 
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TABLE I. Summary of parameters in REM, REMUCA, and MUCAREM simulations. 



Run 



No. of replicas, M 



Temperature, T™ [K] (m = 1, • • • , M) 



MD steps 



REMl 

REM2 

MUCAl 
MUCAREMl 



10 

10 

1 
4 



200, 239, 286, 342, 409, 
489, 585, 700, 836, 1000 
200, 239, 286, 342, 409, 
489, 585, 700, 836, 1000 
1000 
375, 525, 725, 1000 



2 X 


10" 


1 X 


10'5 


1 X 


10^ 


2.5 X 10*^ 



TABLE II. Acceptance ratios of replica exchange in REMl. 



Pair of temperatures [K] 



Acceptance ratio 



200 
239 
286 
342 
409 
489 
585 
700 
836 



239 
286 
342 
409 
489 
585 
700 
836 
1000 



0.15 
0.16 
0.15 
0.14 
0.13 
0.13 
0.13 
0.14 
0.15 



TABLE HI. Summary of parameters in MUCAREMl. 



T, 



{m} 



:ki 



T, 



•> [K] 



E 



{m} 



[kcal/mol] 



EJ^^ [kcal/mol] 



200 
300 
375 
525 



375 
525 
725 
1000 



-30 
-5 
20 
65 



20 
65 
120 

195 



TABLE IV. Acceptance ratios of replica exchange MUCAREMl. 



Pair of temperatures [K] 



375 
525 

725 



525 
725 
1000 



Acceptance ratio 
025 
0.35 
0.32 



Figure Captions 

• Fig. 1. Probability distribution of potential energy obtained from REMl (see Table I for the parameters of the 
simulation). 

• Fig. 2. Probability distribution of potential energy obtained from MUCAl (see Table I). The dotted curves are 
the probability distributions of the reweighted canonical ensemble at T = 200 K (left) and 1000 K (right). 

• Fig. 3. Probability distributions of potential energy obtained from MUCAREMl (sec Tables I and III). 

• Fig. 4. Time series of potential energy for one of the replicas in (a) REM2, (b) MUCAl, and (c) MUCAREMl 
(see Tables I and III for the parameters of the simulation) . 

• Fig. 5. The average potential energy as a function of temperature. The solid, dotted, and dashed curves are 
obtained from REM2, MUCAl, and MUCAREMl, respectively (see Tables I and III for the parameters of the 
simulations). 
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